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OBJECTIVES 


To examine various issues and concepts 
involved in KBSs involved in KBSs 

To examine various techniques used to 
build KBSs 

To examine (at least one) KBS in detail 
( i . e . , case s t udy ) 

To list and identify limitations and 
problems with KBSs 

To suggest future areas of research 


To provide extensive references 
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CHABACTERISTICS OF KBSs 


Organization of Knowledge 
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FIGURE 2-1. KBS ELfMENTS AND THEIR RELATIONSHIP 
BASED ON ChAYES-ROTH^ ET fiL, '83] AND CBARNETT & BERSTEIN^ '773 

















TECHNIQUES USED TO CONSTRUCT KBSs 
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Inference Engine (IE) 


Primary Functions of IE 
Some Definitions 
IE St rat egi es 

Methods of Implementing the IE 
Measures of Performance 

Workspace Representation 

Introduction 
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AND/OR Graph 

Blackboard Versus AND/OR Graph 
The Interface 

Functions of the Interface 
User Interface 
Expert Interface 

Knowledge Acquisition (KA) Process 



Table 3-1 ORIGINS OF KBS TECHNIQUES 
(Based on [Barnett & Bernstein, 77]) 


ARTIFICIAL INTELLIGENCE (AI ) 

Heuristic Search 
Inference and Deduction 
Pattern Matching 
Knowledge Representation and 

Acqu i s i t i on 
System Organization 

LANGUAGE PROCESSING 

Parsing and Understanding 
Question and Response Generation 
Knowledge Representation and 

Acqu i s i t i on 

THEORY OF PROGRAMMING LANGUAGES 

Formal Theory of Computational 
Power 

Control Structures 
Data Structures 
System Organization 
Parsing 


MODELING AND SIMULATION 


Representation of Knowledge 
Control Structures 
Calculation of Approximations 

DATA BASE MANAGEMENT 

Information Retrieval 
Upda t i ng 

File Organization 

SOFTWARE ENGINEERING 

System Organization 
Do c ume n t a t ion 

Iterative System Development 

APPLICATION AREAS 

Doma i n - Spe c i f i c Algorithms 
Human Engineering 


IMPORTANCE 


DOMAIN I 

SPECIFIC i — ** AVAILABLE 

ITEMS I TlCIfllQUES 



FIGURE 3-1. 


BASED ON CbARNETT & BERSTEIN^ '773 












KNCWVLEDGE REPRESENTATION METHODS 


Finite state ma chines 
Programs 

Predicate calculus 
Production rules 
Semantic networks 
Frames 


Representation = Knowledge + Access 

[Newe 11, 82 ] 



PRODUCTION SYSTEM COMPONENTS 


Three parts [Barr Feigenbaum, 81]: 

A Rule Base: A collection of 

production rules. 

A Workspace: A buffer like data 

structure. 

An Interpreter: Which controls 

s y s t em activity 


the 


INTERPRETER TASKS 


Matching or 

Building a Conflict-Set 
Confl ict -Resolut ion 
Action or Execution 

CONFLICT RESOLUTION STRATEGIES 

Rule Order 
Ru le Precedence 
Generality Order 
Data Order 
Regency Order 


Non -De t e rmi n i s t i c 



AN EXAMPLE 


Automotive Repair Agency 


The System Contains 


Knowledge Base of production rules 
(Performance characteristics and 
Measurable attributes) 


A Database 

(Past problems. Repairs, and 
Service perfo rme d ) 



R1 IF fan belt tension is low 

THEN alternator output will be low [.5] 
and engine will overheat [.2] 

R2 IF alternator output is low 

THEN battery charge will be low [.7] 

R3 IF battery is low 

THEN car will be difficult to start [.5] 

R4 IF automatic choke malfunctions OR 
automatic choke needs adjustment 
THEN car will be difficult to start [.8] 

R5 IF battery is out of warranty 

THEN battery charge may be low [.9] 


Figure 3-9 PRODUCTION RULES FOR 
AUTOMOTIVE SYSTEMS KS 



R6 


IF coolant is lost OR coolant system 
pressure cannot be maintained 
THEN engine will overheat [.7] 

R7 IF there is a high resistance short 
AND fuse is not blown 
THEN battery charge will be low [.8] 

R8 IF battery fluid is low 

THEN battery will boil off fluid [.3] 

R9 IF battery fluid is 1 ow 

THEN battery charge will be low [.4] 


Figure 3-9. PRODUCTION RULES FOR 
AUT(»«DTIVE SYSTEMS KS (CONT’D) 



OBSERVATIONS 
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Figure 3-10. DATA GATHERING PROCEDURE 
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FIGURE 3,11 EXAMPLE FLOW IN AUTO DIAGNOSTIC SYSTEM 










FIGURE 3-14. CHARACTERISTICS OF PRODUCTION 
BASED ON CbARNETT & BERNSTEIN^ '773 












SEMANTIC NETV^RKS 


Semantic networks are used in 

Psychological modeling of human memory 
Programning languages 
Natural language understanding 
Data base management systems 

A SEMANTIC NETW3RK (or NET) consists of 
nodes and links. 


RELATIONS 

TEMP (warm-blooded MAMMAL) 

I sa(dog> mammal) I sa(cat^ mammal) 

ISA(FrDO^DOG) ISA(BOWSERiDOG) ISA(PUFF^CAT) 

loc(mary's.fido) locCfirehouse, bowser) loc(bob's,puff) 

COLOR (TAN> FIDO) COLOR (TAN^, BOWSER) COLOR (BLACK, PUFF) 

size(40lb,fido) size(14lb, bowser) size(4lb,puff) 

BETWEEN (MARY ' S, F I REHOUSE, BOB ' S ) 


SEMANTIC NETWORK 

MAMMAL 



RULES OF INFERENCE 


isa(x,y) isa(y,z) => isa(x,z) 
size(x,y) a size(u,v) a x<u => smaller(y,v) 
ISA(X,y) a r(u,y) => r(u,x) 

FIGURE 3,15 EXAMPLE SEMANTIC NETWORK 



INFERENCES 


First Ru 1 e 

FUFF is a cat and CAT is a MAAAIAL ; 
therefore , PUFF is a MAAAIA.L . 


Second Rule 

SIZE(4,PXn!'F) & SIZE( 14, BOWSER) & 4 < 14 

= > SMALLER ( PUFF , BCWVSER) 


Third Rule 

ISA(FIDO, DOG) & ISA(DOG, MA&A1^ ) 

= > ISA(FIDO, MAMMAL) 

ISA(FIDO, MAAMAL) & 

TEMP (WARM-BLOODED , MAMMAL ) = > 
TEMP (FIDO, WARM-BLOODED) 


MEANINGLESS INFERENCE 


ISA(DOG, MAMMAL) & ISA (CAT, MAM^IAL) 

=> ISA(DOG, CAT) 


INHERI TABLE ( TEMP ) 


ISA(x, y) & r(u, y) & 

INHERITABLE! r ) => r(u.x) 


CURRENT RESEARCH 


Wh at does a node (object) really me an? 

Is there a unique way to represent an 
idea? 

How is the passage of time to be 
represented? 

How does one represent things that are 
not facts about the world but rather 
ideas or beliefs? 

What are the rules about inheritance of 
properties in networks? 



FRAMES 


Frame Characteristics 

De script ion 

Inst an t i a t i on 

Prediction or Exp ectation 

Jus tification 

Var i a t i on 

Correction 

Per t ur ba t i on 


T r a n s f o rma t i o n 


I S A mamna 1 


1 dog FRAME 

2 kind breed 

3 color SUBSET. OF {tan brown black 

wh i t e rust} 

4 ER(^ color OF k i nd 


5 

6 

7 

8 

9 

10 


1 eggednes s 
weight 
state 

age 

b i r t hday 
name 


0 . . 

>0, EBOM Q£ kind 


adu 1 t OR 

p^ppy i ^ ^ 1 



da t e 


s t r i ng 


11 END dog 


(a) 


Figure 3-16. EXAMPLE FRAME DEFINITIONS 
[Barnett & Bernstein, 77] 



1 

2 

3 

4 

5 

6 

7 

8 


boxer FRAME ISA 
color 

size 

tail 

ears 

t emp e rme n t 
COMPLAINTS 

END 


breed OF dog 
ONE . OF { t an 

brown br indie} 

40. . .60 

bobbed OR long 
bobbed OR floppy 
p 1 ay f u 1 

IF weight > 100 

THEN ASSUME (great dane ) 

boxer 


(b) 


Figure 3-16. EXAMPLE FRAME DEFINITIONS 
(CONT'D) [Barnett & Bernstein, 77] 


LCW- LEVEL INFORMATION 


OBJECT 654 

color =tan 

ears = bobbed 

leggedness = 4 
size = 40 - 45 

temperment = mean 

TRIAL IDENTIFICATION 

[OBJECT 654 ISA dog 

kind boxer WITH [color tan 

size 40 - 45 
tail ASSUMED bobbed 
ears bobbed 
t emp e rme n t EXCEPT I ONAL 

mean ] 

color t an 

leggedness 4 
weight 40 - 45 

state ASSUMED adult] 

i 

Figure 3-17. INEXACT MATCH BY A FRAME SYSTBM 

[Barnett & Bernstein, 77] 



INFERENCE ENGINE CONTROL STRATEGIES 


Forward chaining 
Backward chaining 
Chain both ways 
Middle term chaining 
Fixed directionality 
Variable directionality 
Hybrid strategy 
Br eadth- f i r s t 


Depth - first 



FORWARD CHAINING 





FIGURE 3 . 18 CHAINING FXAMPt 



BREADTH -FIRST CONTROL STRATEGY 


An Example: 8 -Puzzle 


H — - - + — - — h 

I 2 I 8 I 3 I 

+ ““~H — “ — I — “ — h 
I 1 I 6 I 4 I 

+ + “ (■ 

I 7 I - I 5 I 

+ + + + 

a . 


+ + + + 

I 1 I 2 I 3 I 

4- -j — - — |- — - -|- 

18 1-14 1 

-i-.-- - + - - — 

I 7 I 6 I 5 I 

+ + + + 

b. 



FIGURE 3-21, THE TREE PRODUCED BY A BREADTH-FIRST SEARCH 

BASED ON [NILSSON, 7H 





















F I GURE 3-22 . DEPTH-FIRST BACK CHAINING 
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METHODS OF IMPLEMENTING THE IE 


Search Me t h o d s 
Simulation Methods 
Pattern Matching 


SEARCH SYSTEM COMPONENTS 

Five ma j o r c omp o n e n t s 

Select 

Expand 

Evaluate 

Prune 


Te rmi na t e 


EVALUATION FUNCTION 


"The purpose of an evaluation 
function is to provide a means for 
ranking those nodes (activities) 
that are candidates for expansion 
to determine which one is most 
likely to be on the best path to 
the goal" [Nilsson, 71]. 


A* 


AN OPTIMAL SEARCH ALGORITHM 


In A*, the evaluation function, 
f'(x) is the cost of a solution 
path constrained to go through node 
x; f’ should be minimized . 


f ' (n(i)) 


n(j+l)) 1<=1 


f'(n) = f'jstart, 

f ’ (n ) = g( 

f (n) = g ’ (n) 


n) 

+ 

f ■ ( n , goal ) 

n) 

+ 

h(n) 

+ 

h 

' (n) . 


=m 



MEASURES OF PERFORMANCE 


Search Techniques 


Pene trance 
P = L/T 

L length of the derived path 
f r om initial to goal 
T total number of nodes 


Branching Factor 




W3RKSPACE REPRESENTATION 


Plan 
Agenda 
History 
Solution Set 


METHODS 


HEARSAY Blackboard 


AND/OR Graph 



HEARSAY BLACKBOARD 


A data structure 

Hypotheses and support criteria 
s t or ed 

Intermediary between KSs and IE 



-LEVELS- 


-KNOWLEDGE SOURCES- 


CONCEPTUAL 

PHRASAL 

LEXICAL 

SYLLABIC 

SURFACE 

PHONEMIC 

PHONETIC 

SEGMENTAL 

PARAMETRIC 



SEMANTIC WORD HYPOTHESIZER 

SYNTACTIC PARSER 
SYNTACTIC WORD HYPOTHESIZER 
PHONEME HYPOTHESIZER 

WORD CANDIDATE GENERATOR 
PHONOLOGICAL RULE APPLIER 

PHONE-PHONOME SYNCHRONIZER 

PHONE SYNTHESIZER 

SEGMENT PHONE SYNCHRONIZER 

PARAMETER SEGMENT SYNCHRONIZER 
SEGMENTER CLASSIFIER 


FIGURE 3-28. HEARSAY II LEVELS OF REPRESENTATION ' 
AND KNOWLEDGE SOURCES BASED ON CeRMAN> ET AL> '803 


USER INPUT 


Parsing Strategies 

Backtracking Versus Parallel Processing 
Top Down Versus Bottom Up Processing 
Choosing How to Expand or Combine 


Multiple Knowledge Sources 



PARSING SYSTEMS 


Template matching 
Transition networks 


Semantic grammar parsers 



TEMPLATE MATCHING 

E.g., ELIZA, SIR, STUDENT 

$1 x(i) {IS/ARE} NOT $2 
VWIAT IF x(i) 'WERE $(2) ? 

"Today's temperature is not hot" 
'"What if temperature were hot?" 



RECURSIVE TRANSITION NETVDRKS 


E.g., "The little boy in the 
kicked the red ball" 

NP: The little boy in the 

PP : in the swimsuit 

NP : the swimsuit 

Ve r b : k i eked 


swims u i t 


swimsu i t 


NP : t he r ed ba 1 1 


s: 


pp 



NP; 


<ADJ> <PP> 



PP: 



I 


I 


FIGURE 3-32, A RECURSIVE TRANSITION NETV^K 
BASED ON CbARR & FEIGENBAUN^ '813 


AUGMENTED TRANSITION NEIVWDRKS 


ATN --> RTN extended in three ways 

Reg i s t e r s 
Te s t s 


Ac t i ons 


DIFFICULTIES IN EXPLANATIONS 
f 


Exp 1 anat i ons 

Mu St be in te rms o f 

Knowledge chunks 
Problem parameters 
Inference rules 

Must be translated to human 
understanding 


METHODS OF PROVIDING EXPLANATIONS 


Workspace Representation 
Using Knowledge Source(s) 


Re-solve the Problem 



FIGURE 3-33. STAGES OF KNOWLEDGE ACQUISITION 
BASED ON tHAYES-ROTH^ET AL, '833 





DIFFICULTIES IN KA 


Representational mismatch 

Verbalization by the expert 
(Protocol study) 

Limitations on current technology 


KA bo 1 1 1 ene ck 


KBS BUILDING TOOLS AND LANGUAGES 


General purpose progranming languages 
Skeletal syst ems 

General purpose representation languages 
Computer-aided design tools for KBSs 

Case Studies 

- EMVrCIN 

HEARSAY- III 


AGE 


INITIAL CONSIDERATIONS 


Task suitability 
Availability of expert 
KA process 

Agreement with the domain theory 
Expe r t ' s mode 1 

Expert's principles of reasoning 
Intermediate levels of abstraction 
General versus domain specific knowledge 
End users 

Unanticipated support 


Cost versus benefits 



TECHNOLOGY CONSIDERATIONS 


Building the prototype system 
Chunk size 

Representation of knowledge 
Inference engine 
Meta knowledge 
Procedural knowledge 

Addition of knowledge by the users 
Ex tensibility 

Knowledge representation tools 


Des ign of tools 


KNCM/LEDGE REPRESENTATION TOOLS 


Genera 1 i ty 

Appropr lateness 

Access i bi 1 i t y 

Exp lanation/Interaction 

Problem characteristics 
Too 1 f eatur es 


versus 


DESIGN OF TOOLS FOR BUILDING KBSs 


Genera 1 i t y 
Comp leteness 

High-level representation language 
Exp lanation/interaction facilities 
Data representation 
Control structure 


ENVIRONMENTAL CONSIDERATIONS 


Interactive KBS s 
Interactive develo pme n t 
Local operating environment 



SUMMARY 



CONCLUSIONS 


Wide spectrum of application areas 
Highly successful 

Some systems are being used routinely 
(DENDRAL, MYCIN, R1 , PROSPECTOR) 

Not yet commonly understood 
(Few "data points") 

Ma j o r mo tivations 

Rep lication/Distri but ion expertise 

Union of expertise 


Do c ume n t a t i o n 



Building ESs expensive and time-consuming 
($1-2 million; 5 person-years with tools) 

General level of accomplishment high 

Number of unresolved issues 

Difficulties and potential risk 

High expe c tat i ons /mi sunder s t and i ngs 


POTENTIAL FUTURE RESEARCH AREAS 


Knowledge acquisition 
Representation theory 
Comparision of techniques 
KBS building tools 
Exp 1 ana t i on 
Eva 1 nation 
Parallel processing 
Learning from experience 
Management of knowledge 
Abstraction and hierarchies 
Technological innovations 


Uniform terminology 
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